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ABSTRACT 


This  is  the  third  in  a  series  of  studies  investigating  the  applicability 
of  multidimensional  scaling  techniques  in  the  job  performance  area.  In  this 
study,  the  circuits  repaired  by  Naval  aviation  electronics  technicians  in  the 
performance  of  their  duties  were  used  as  the  stimulus  materials.  Similarity 
judgments  among  the  circuit  pairs  were  made  by  supervisory  personnel  and 
analyzed  by  multidimensional  scaling  methods. 

It  is  concluded  that  it  is  feasible  and  fruitful  to  apply  multidimensional 
scaling  techniques  to  the  classification  of  electronic  circuits  worked  on  in  the 
performance  of  Naval  jobs.  The  avionic  circuits  repaired  by  Naval  aviation 
electronics  technicians,  as  represented  in  the  circuit  list  developed  in  the 
study,  were  perceived  as  involving  sixteen  underlying  dimensions. 
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CHAPTER  I 


INTRODUCTION 


In  its  search  for  general  laws,  science  often  attempts  to  reduce  a 
complex  set  of  variables  to  a  smaller  number  of  fundamental,  underlying 
variables.  The  organization  of  knowledge  in  terms  of  "building  blocks"  is 
presumed  to  increase  both  the  simplicity  of  the  formal  statement  of  laws  and 
the  understanding  of  the  phenomenon  under  examination.  Although  stating  laws 
simply  is  generally  considered  to  possess  merit,  the  more  important  reason 
for  identifying  underlying  factors  is  the  enhancement  of  knowledge  and  under¬ 
standing.  Thurstone  stressed  this  role  of  variable  reduction  in  the  growth 
of  knowledge  when  he  stated: 

"The  criterion  by  which  a  new  ideal  construct  in 
science  is  accepted  or  rejected  is  the  degree  to 
which  it  facilitates  the  comprehension  of  a  class  of 
phenomena  which  can  be  thought  of  as  examples  of 
a  single  construct  rather  than  as  individualized 
events.  It  is  in  this  sense  that  the  chief  object  of 
science  is  to  minimize  mental  effort"  (1947,  p.  52). 

It  is  not  necessary  that  a  selected  set  of  variables,  examined  from 
the  standpoint  of  possible  reduction  to  fewer  underlying  factors,  be  the  only 
possible  set  that  can  be  generated  with  respect  to  an  object  or  series  of  events. 
For  example,  an  automobile  may  be  viewed  as  a  transport  device  and  a  group 
of  measures  related  to  that  concept  can  be  developed  and  analyzed.  On  the 
other  hand,  one  might  be  concerned  with  the  effects  of  the  automobile  on  the 
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family's  economic  status  or  on  urban  development,  in  which  case  different, 
though  internally  complete,  sets  of  variables  might  be  used.  In  the  same 
manner,  behavior  may  be  examined  in  terms  of  its  causes,  its  effects,  its 
characteristic  manifestations,  etc.  Within  each  defined  class  of  variables, 
a  consistent  underlying  structure  may  be  developed  whose  utility  will  normally 
be  limited  only  by  the  adequacy  and  ease  with  which  the  substrate  accounts  for, 
or  reproduces,  those  variables.  Each  group  of  underlying  variables  may  be 
considered  as  "basic"  in  the  sense  that  it  ". . .  facilitates  the  comprehension 
of  a  class  of  phenomena  which  can  be  thought  of  as  examples  of  a  single  con¬ 
struct  rather  than  as  individualized  events.  " 

It  is  reasonable,  then,  that  analyses  of  different  constructs  might 
produce  different  types  of  "fundamental  factors.  "  Furthermore,  it  would 
seem  likely  that  combining  such  groups  of  factors  in  an  interactive  manner 
should  lead  to  considerably  broader  comprehension  of  the  phenomenon  being 
studied. 

In  considering  the  nature  of  a  job,  it  is  not  difficult  to  conceive  of 
several  different  classes  of  variables  that  can  be  generated.  For  example, 
Palmer  and  McCormick  (1961)  have  differentiated  "worker  oriented"  job 
descriptions,  emphasizing  worker  activities,  from  "job  oriented"  descrip¬ 
tions,  emphasizing  the  technological  aspects  of  the  job.  A  job  might  be 
viewed  from  the  standpoint  of  the  materials  used  or  its  end  products.  Or 
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one  might  work  within  the  framework  of  the  worker  requirements,  i.  e. ,  the 
skills,  knowledges,  and  other  personal  characteristics  needed  for  adequate 
job  performance.  Other  types  of  variables  could  be  mentioned.  Analysis  of 
each  class  of  job  related  variables  is  probably  useful  in  answering  certain 
questions  and,  in  concert,  such  varied  analyses  should  lead  to  a  more  thorough 
understanding  of  a  job. 

Two  recent  Applied  Psychological  Services'  studies  (Schultz  and 
Siegel,  1962;  Siegel  and  Schultz,  1963)  explored  the  applicability  of  multi¬ 
dimensional  scaling  techniques  to  two  levels  of  the  job  of  the  Naval  aviation 
electronics  technician  (AT).  In  this  research,  the  job  was  analyzed  in  terms 
of  the  tasks  performed  by  the  typical  AT  in  the  Fleet.  In  the  first  study 
(Schultz  and  Siegel,  1962),  four  basic  dimensions  were  found  to  account  for  the 
AT  job  at  the  striker  and  petty  officer,  third  class,  level;  nine  dimensions  were 
extracted  in  the  study  of  AT  supervisory  personnel  (Siegel  and  Schultz,  1963), 
including  all  four  of  the  dimensions  characterizing  the  lower  job  level. 

Methodologically,  these  studies  demonstrated  the  feasibility  and  fruit¬ 
fulness  of  applying  multidimensional  scaling  techniques  in  the  job  performance 
area  through  use  of  the  specific  methods  that  were  developed  for  this  purpose. 
The  nature  of  and  the  rationale  underlying  multidimensional  scaling  analysis, 
as  well  as  its  relevance  for  job  performance  measurement,  have  been  fully 
discussed  in  the  earlier  reports.  Essentially,  multidimensional  scaling  pro¬ 
vides  procedures  designed  to  account  for  the  perceptions  of  the  psychological 
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distances  amoung  a  set  of  stimuli  in  terms  of  a  minimum  number  of  basic 
dimensions.  The  source  data  are  usually  judgments  of  over-all  similarity 
among  the  stimuli  and  the  outcomes  are  (1)  the  number  of  axes  which  account 
for  the  space  defined  by  the  judgments  and  (2)  the  projections  of  the  stimuli 
on  the  axes. 

Another  possible  approach  to  gaining  an  understanding  of  the  electronics 
technician's  job  would  be  to  view  it  from  the  standpoint  of  the  kinds  of  equip¬ 
ment  on  which  the  technician  works.  At  a  more  molecular  level,  the  avionic 
circuits  involved  in  that  family  of  equipments  might  be  examined.  If  groups 
of  circuits  could  be  isolated  that  are  independent  of  each  other  in  the  sense 
that  within  group  repairs  call  for  the  same  worker  behaviors  while  repairs  of 
different  groups  call  for  different  worker  behaviors,  it  should  then  be  possible 
to  describe  any  particular  mission  in  terms  of  such  circuit  type  demands  and/or 
to  evaluate  personnel  separately  with  respect  to  their  ability  to  repair  each 
different  circuit  type.  It  might  also  be  possible  to  build  a  cross -dimensional 
construct  of  the  AT  job  by  relating  each  of  the  task  dimensions  previously 
extracted  to  each  of  the  circuit  types. 

Purposes  of  the  Present  Study 

The  present  study  was  designed  to  extend  the  investigation  of  the 
applicability  of  multidimensional  scaling  techniques  in  the  job  performance 
area  to  the  types  of  circuits  worked  on  by  Naval  aviation  electronics  technicians. 


-  4  - 


The  specific  purposes  were  to:  (1)  assess  the  value  of  multidimen¬ 
sional  scaling  techniques  for  classifying  electronic  circuits,  (2)  adapt  and 
investigate  the  applicability  to  electronic  circuits  of  previously  devised 
methods  for  utilizing  these  techniques,  and  (3)  determine  the  number  and  the 
nature  of  the  dimensions  underlying  the  circuits  repaired  by  Naval  aviation 
electronics  technicians. 
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CHAPTER  II 


DEVELOPMENT  AND  ADMINISTRATION  OP  CIRCUIT  LIST 


The  previous  two  Applied  Psychological  Services'  studies  of  the  appli¬ 
cability  of  multidimensional  scaling  techniques  to  job  performance  (Schultz  and 
Siegel,  1962;  Siegel  and  Schultz,  1963)  had  developed  and  utilized  forms  and 
procedures  for  obtaining  the  basic  data  required  for  multidimensional  scaling 
in  a  job  performance  context.  The  same  methods,  adapted  to  fit  electronic 
circuitry  content,  were  used  in  this  research. 

Preliminary  Circuit  List 

The  focus  of  the  research  described  in  this  report  was  on  the  electronic 
circuits  found  in  'he  equipment  which  is  characteristically  repaired  by  Naval 
aviation  electronics  technicians  (AT's).  A  preliminary  list  of  these  circuits 
was  prepared  by  a  design  engineer  who  has  had  considerable,  diversified 
experience  with  a  multiplicity  of  systems  and  types  of  circuits.  He  was  asked 
to  include  all  the  different  circuits  that  an  AT  might  normally  be  expected  to 
encounter,  at  a  level  of  abstraction  that  would  result  in  a  number  of  circuits 
which  would  make  feasible  obtaining  the  needed  similarity  comparisons.  The 
degree  of  detail  inherent  in  the  experimental  outcomes  was  to  a  large  extent 
determined  by  this  specification. 
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The  preliminary  list  was  composed  of  the  names  of  34  circuit  types, 
which  were  assembled  in  booklet  form.  The  following  directions  were  given 
on  the  cover  page  of  the  booklet: 

The  purpose  of  this  questionnaire  is  to  determine  the 
circuits  in  which  AT's  isolate  malfunctions  and/or  which  AT's 
repair  in  the  Fleet.  We  want  to  obtain  a  list  of  the  circuits 
worked  on  by  a  representative  sailor  in  this  rating. 

First,  look  over  the  list  to  get  an  idea  of  what  circuits 
are  included.  Then: 

1.  Co  through  the  list  and  check  in  the  column 
labeled  "AT  Striker/3rd  Cl.  "  all  the  cir¬ 
cuits  which  are  normally  and  characteris- 
tically  worked  on  (isolating  malfunctions 

in  and/or  repairing)  by  Striker  and  Third 
Class  AT's  in  the  Fleet!! 

2.  Go  back  and  place  a  check  in  the  second 
column  next  to  all  the  circuits  which  are 
normally  and  characteristically  worked 

on  (isolating  malfunctions  in  and/or  repair¬ 
ing)  by  t irst  Class  and  Chief  AT's  in  the 
Fleet. 

You  may  know  of  a  particular  sailor  who  has  isolated  mal¬ 
functions  in  and/or  repaired  some  of  the  listed  circuits,  even 
though  most  AT's  do  not.  Or,  in  a  particular  squadron  with  which 
you  are  familiar,  the  AT's  may  work  on  certain  circuits  not  nor¬ 
mally  encountered  by  most  of  the  men  in  this  rating.  Do  not  check 
such  circuits. 

If  there  are  any  circuits  normally  worked  on  (isolating  mal¬ 
functions  in  and/or  repairing)  by  AT's  in  the  Fleet  which  are  not  in¬ 
cluded  in  the  questionnaire,  please  write  them  in  under  "Other"  on 
the  last  page.  Be  sure  to  check  whether  these  circuits  are  worked 
on  by  Strikers  and  Third  Class  men  or  by  First  Class  men  and  Chiefs 
or  by  both. 
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The  intent  of  the  last  paragraph  was  to  provide  the  opportunity  for  the 
respondents  to  expand  the  list  to  include  any  types  of  circuits  overlooked  by  the 
engineer  who  constructed  it. 

Final  Selection  of  Circuits 

The  form  containing  the  preliminary  list  of  circuits  was  administered, 
in  two  groups,  to  22  instructors  assigned  to  the  AT  school  at  the  Naval  Air 
Technical  Training  Command  in  Memphis,  Tennessee.  All  of  these  instructors 
had  made  analogous  judgments  regarding  the  tasks  performed  by  the  typical 
aviation  electronics  technician,  data  which  provided  the  "raw  material"  for  the 
previous  multidimensional  analyses.  Their  qualifications  for  making  these 
critical  judgments  were  impressive:  they  were  chief  petty  officers  or  petty 
officers,  first  or  second  class,  in  the  AT  rating,  had  recently  arrived  at  the 
school  from  Fleet  duty,  had  an  average  of  about  7.  5  years  of  military  expe¬ 
rience  in  electronics  or  electrical  work,  had  an  average  of  about  5.  5  years  of 
experience  as  an  AT,  and  had  been  assigned  as  an  AT  to  an  average  of  about 
2.25  different  squadrons  during  their  careers. 

Following  completion  of  the  form  by  the  instructors,  the  groups  were 
asked  for  informal  comments  as  to  the  over-all  completeness  of  the  list  and  any 
other  aspect  of  the  responses  that  had  been  requested  of  them.  Although  they 
felt  generally  somewhat  less  at  ease  with  the  circuit  list  than  they  had  felt  with 
the  task  list,  there  were  no  serious  criticisms  or  major  corrections  mentioned. 

Examination  of  the  responses  revealed  that  very  few  circuit  names 
had  been  added  to  the  list  in  the  spaces  provided  for  "other"  circuits; 
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because  of  their  limited  generality  and  their  apparent  lack  of  general  accept¬ 
ance  by  the  group,  those  which  had  been  added  did  not  appear  to  warrant 
fi.rther  attention. 

There  was  a  very  high  degree  of  agreement  among  these  experienced 
men  as  to  which  of  the  circuits  are  worked  on  by  typical  chief  petty  officers 
and  petty  officers,  first  class,  in  the  AT  rating.  Out  of  the  total  of  34  possible 
circuits,  31  were  checked  by  18  or  more  of  the  instructors  and  30  of  these  were 
checked  by  20  or  more  men  There  was  considerably  less  agreement  with 
respect  to  the  circuits  the  typical  strikers  and  petty  officers,  third  class, 
repair.  The  frequency  with  which  a  specific  circuit  was  chosen  scattered  from 
4  to  22.  However,  the  31  circuits  mentioned  above  included  all  those  relating 
to  the  striker  level  down  to  a  selection  frequency  of  10.  Out  of  the  original 
list  of  circuit  types,  the  31  excluded  only  phototube,  induction  motor,  and 
resonator. 

From  these  data,  then,  it  appeared  that  the  31  circuits  checked  by  18 
or  more  of  the  judges  included  all  the  circuit  types  that  are  normally  worked 
on  by  aviation  electronics  technicians  although  some  of  these  would  not 
necessarily  be  encountered  until  the  sailor  reaches  the  higher  levels  in  the 
rating.  These  31  circuits,  therefore,  were  taken  as  the  basis  for  the  multi¬ 
dimensional  scaling  analysis  of  circuit  types: 
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1.  Mixer 

2.  Cathode  follower 

3.  Klystron 

4.  Waveguide 

5.  Attenuator 

6.  Servomechanism 

7.  Ringing 

8.  Magnetron 

9.  Single -shot  multivibrator 

10.  Flip-flop 

11.  Transformer 

12.  Filter 

13.  Thyratron  trigger 

14.  Detector 

15.  Voltage  doubler 

16.  Automatic  frequency  control 

17.  Rectifier 

18.  Bridge 

19.  Sweep  oscillator 

20.  Frequency  discriminator 

21.  Modulator 

22.  RF  oscillator 

23.  Regulator 

24.  Blocking  oscillator 

25.  Integrator 

26.  Clipping 

27.  Peaking 

28.  DC  restorer 

29.  Cathode  ray  tube 

30.  Differentiator 

31.  Inverter 


The  Multidimensional  Scaling  Form 

A  booklet  was  devised  so  that  judgments  of  the  similarity  between  each 
pair  of  circuits  could  be  obtained  through  group  administrative  procedures. 

At  the  top  of  each  page,  one  of  the  31  circuit  names  was  presented.  Below 
it,  along  the  left  side  of  the  page,  from  one  to  all  (30)  of  the  remaining  circuit 
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names  appeared  in  columnar  form.  The  number  of  circuit  names  listed  on 
any  page  was  variable  because  the  judgment  of  similarity  between  each  pair 
of  circuits  was  requested  only  once  from  each  respondent.  If  circuit  "B" 
had  been  compered  to  circuit  "A"  appearing  at  the  top  of  a  page,  circuit 
"A"  was  not  included  in  the  list  when  "B"  appeared  at  the  top  of  a  page.  The 
circuits  on  each  page  were  presented  in  a  random  order  which  differed  from 
one  page  to  another. 

A  scale  of  11  points  was  printed  to  the  right  of  each  circuit  name. 

Scale  points  1  and  2  were  labeled  as  representing  a  judgment  of  "very  similar"; 
points  3,  4,  and  5,  were  labeled  as  representing  "moderately  similar";  points 
7,  8,  and  9  were  labeled  as  representing  '  moderately  different"  and  points 
10  and  11  represented  "very  different  "  Scale  point  6.  in  the  middle  of  the 
scale  range,  was  not  described.  The  booklet  page  winch  contained  all  the 
circuits  is  shown  as  Table  1;  a  sample  of  the  other  pages  is  shown  as  Table  2. 

The  booklet  was  called  the  Technical  Circuit  Inventory.  After  giving  a 
brief  statement  of  the  purpose  of  the  questionnaire  and  the  page  layout,  the 
directions  said,  "You  should  think  about  working  on  (that  is,  isolating  mal¬ 
functions  in  and/or  repairing)  each  circuit  in  the  list  as  compared  with  working 
on  the  circuit  at  the  top  of  the  page.  Then,  you  should  place  a  check  in  the 
appropriate  column  to  the  right  to  indicate  how  similar  or  different  you  think 
working  on  the  two  circuits  is.  "  Responses  to  three  illustrative  comparisons 
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Table  1 


Page  of  the  Technical  Circuit  Inventory  Containing  all  Circuits 


MIXER 

VERY 

MODERATELY 

HOOCAATCLY 

VERY 

SIMILAR 

SIMILAR 

01 FFCRENT 

OIFFERENT 

t  Z 

5  *  5 

( 

7  «  J 

10  II 

TRANSFORMER  _  _ 

_  _  ■  - 

-  , 

- MM _ 

«MM  M 

DETECTOR  _  _ 

_  _  _ 

MM 

—  ■  - -  y — | - - 

SINGLE— SHOT  MULTIVIBRATOR  _  _ 

mm  _  _ 

.M_ 

MM  ~  - 

- -  - 

CATHODE  RAY  TUBE  _  _ 

_  — _  _ 

_ 

MM  Mm  - 

MM  -  - 

MODULATOR  _  _ 

_  _  _ 

MM 

MM  - 

-  - 

MAGNETRON  _  _ 

_  — —  _ 

MM 

—  MM  MM. 

MM  - 

FLIF-FLOP  _  _ 

_  _  _ 

MM 

-MM  MM 

-  - 

wavequioe  _  _ 

_  _  _ 

MM 

- - - 

-  ■  ■  _m 

attenuator  _  _ 

_  _  _ 

MM 

MM  ~  MM 

MM  -  - 

cliff ino  _  _ 

—  -  - - 

. 

M M  _^M  MM 

^■M  MM 

RECTIFIER  _  _ 

-  —  — _ - 

MM 

- -  - 

MM  MM 

AUTOMATIC  FABJUCNCY  CONTAOL  _  _ 

_  _  _ 

_ 

-  -  mm 

MM  - 

BA  ICKM  _  _ 

- - mm 

-  ~  _ 

MM  -  MM» 

-  - 

•MICA  OtCILLATCA  _  _ _ . 

_  MM  mm 

_ _ 

MM  . -  - 

^^M  MM 

CATHOOt  follow  _  ___ 

_  m m  _ 

MM 

-  --  - 

^MM  «MM 

ainoino  _  _ 

-  -  _  - 

MM 

MM  MM. 

MM  -^M 

FILTCA  _  _ 

mm  -  -  - 

_ 

«mm 

AF  OOCtLLATOA  _  _ 

- 

_ 

DIFFERENTIATOR  _  _ 

mm  ,  ,  - 

MM 

_ _ 

OC  RESTORER  _  _ 

-  MM  - 

mm 

_ _ 

KLYSTRON  _  _ 

_ 

_ _ 

TMYRATRON  triqocr  _  _ 

-  mm,  mm 

INVCATCA  _  _ 

_  _  _ 

fearing  _ .  _ 

__  M ^ „  ■ 

_ 

VOLTAQC  OOUOLCA  _  _ 

-  —  — 

_  __ 

FACQUCNCV  OIACAIMINATOA  _  _ 

mm. 

BLOCK  1  NO  OACILLATOA  _  _ 

_ 

KAVOMCCHANIBM  _  _ 

MM _ 

_ 

INTtOAATOA  _  _ 

—  MM  MM 

ACOULATOA  _  _ 

MM  MM 
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Table  2 


Sample  Page  of  the  Technical  Circuit  Inventory 


DETECTOR 

VERY 

MODERATELY 

MODERATELY 

very 

8IMILAR 

SIMILAR 

DIFFERENT 

DIFFERENT 

1  2 

J  *»  5 

i 

7  «  J 

10  II 

REGULATOR  -  - 

-  -  - 

— 

-  -  - 

-  - 

MODULATOR  _  _ 

-  -  - 

— 

- - 

— 

BLOCK) NO  OSCILLATOR  _  _ 

-  -  - 

— 

-  -  - 

-  - 

DC  RESTORER  _  _ 

- - 

— 

-  -  - 

-  - 

INVERTER  _  _ 

-  -  - 

— 

-  -  - 

-  - 

FREQUENCY  DISCRIMINATOR  _  _ 

-  -  - 

— 

-  -  - 

-  - 

BRIDGE  _  _ 

-  -  - 

— 

-  -  - 

-  - 

AUTOMATIC  FREQUENCY  CONTROL  _  _ 

— 

— 

— 

— 

VOLTA  at  OOUSLER  __  _ 

— 

— 

— 

-  - 

RECTIFIER  _  — 

- - 

— 

— 

-  - 

INTEGRATOR  _  _ 

-  -  - 

— 

-  -  - 

-  - 

RF  OSCILLATOR  _  _ 

- - 

— 

— 

-  - 

DIFFERENTIATOR  _  _ 

— 

— 

— 

-  - 

CUFFING  _  _ 

— 

— 

- - 

-  — 

CATHODE  RAY  TUBE  _ 

— 

— 

— 

-  — 

FEAKINO  ___  _ 

-  -  - 

— 

-  -  - 

—  — 

SWEEF  OSCILLATOR  _  _ 

— 

— 

— 

— 

ll 
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were  presented  and  the  respondent  was  given  the  opportunity  to  practice 
check  two  more.  The  complete  cover  page  of  the  form,  including  the 
directions,  is  shown  in  Table  3. 

The  number  of  circuits  appearing  on  a  page  could  vary  widely  from 
one  page  of  a  booklet  to  the  next,  because  a  table  of  random  numbers  was 
used  to  establish  the  order  of  pages.  Four  different  random  page  orders  were 
used,  the  forms  being  intermixed  for  administration. 

Subjects 

The  subjects  for  this  study  were  the  same  as  those  used  in  the  previous 
two  applications  of  multidimensional  scaling  analysis.  The  group  consisted  of 
31  chief  petty  officers  and  34  petty  officers,  first  class,  in  the  Naval  aviation 
electronics  technician  (AT)  rating.  Table  4,  also  presented  in  the  earlier 
reports,  shows  the  squadrons  to  which  these  judges  were  assigned  and  their 
locations.  The  men  had  an  average  of  11.2  years  of  military  experience  in 
electronics  or  electrical  work,  had  been  AT's  for  an  average  of  8.  3  years, 
and  had  been  assigned  as  an  AT  to  an  average  of  3.  8  squadrons. 

Administration 

The  Technical  Circuit  Inventory  was  administered  to  the  subjects 
during  the  same  group  sessions  as  the  Technical  Task  Inventories,  the 
analysis  of  which  was  given  in  two  previous  reports  of  this  series.  Following 
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Name 


Today's  I), ill* 


li:(’ll\H  \l  rilU’ITI  INVENTORY 


The  purpose  «>f  this  questionnaire  is  to  *  ompare  i.Milatinj;  nialfuiutions  in  and/or 
repairing  various  elet  trout*  *  1 1*«  uits. 

Tin*  iiatni'  of  our  tyjM*  of  >  ir«  uit  is  «.Ii<iwii  at  the  top  of  ea»  h  page.  Mr  low  it  is  a 
list  of  other  tvjx*s  of  i  in  nits.  You  should  think  about  working  on  (that  is,  isolating 
malfunctions  m  and/or  repairing)  ea«  h  •  iri  in'  m  the  list  as  *  omparetl  with  working  on 
the  circuit  at  the  top  of  the  page.  I'hen.  vou  should  place  a  *  he*  k  to  the  appropriate 
column  to  tlie  right  to  indu  ate  how  .similar  or  different  you  think  working  on  the  two  cir¬ 
cuits  is.  There  are  no  '  right"  or  '  wrong  answers  to  this  Inventory,  your  best  judg¬ 
ments  of  similarity  are  the  only  right’  answers. 

Ilefore  you  beg.n.  ojier.  the  booklet  and  look  over  tin-  pages  briefly  to  get  an  idea 
of  what  *  i r »  uit  tv|>es  are  in*  luded.  \o?i*  e  that  the  pages  have  different  numbers  of  cir- 
i  uits  listed.  Then  start  working  at  the  beginning  of  the  booklet.  Try  to  vary  your  i  heck 
marks  so  that  some  appear  in  all  eleven  *  olumns.  |)n  not  hesitate  to  use  the  extreme 
resjHinses  numbered  I  and  11,  .f  you  feel  ativ  «  ompai'iso:.  deserves  one  of  them. 


The  first  *  he*  k  itieatis  that  *he  person  .  ompletmg  'he  Inventory  thinks  that  isola¬ 
ting  malfumtions  m  and  or  repairing  pho'o'-iN-  *  m  nits  is  wry  different  from  isolating 
malfunctions  in  and  or  rcpa.nng  restu.a'or  *  .r«  mts.  The  se*  ond  *  heck  means  that  the 
jierson  answering  feels  that  working  on  <  «*upling  *  ir*  uits  is  mo*lerately  similar  (to  the 
degree  mdi*  ated  bv  a  a  )  to  working  «*n  rr><m.itor  <  ir«  uits.  \«  »  ording  to  the  «  heck  on 
the  third  line,  working  on  indie  tion  motor  *  ir*  uits  is  mo*lerately  similar  (to  the  degree 
indicated  In  a  C  )  to  working  on  resonator  >  ir<  ails.  You  mav  or  may  not  agree  with 
this  fterson.  I'rv  filling  in  the  last  two  lines  \ourself. 

UHFN  YC»r  II  \Yt:  KIMSilH).  CHICK  H  \CK  lo  M  \KK  CKRTAIN  YOI  H.WK  H.XCFD 
A  CIIKCK  M  NT  TO  F  NCII  T  YSk  IN  TIIF  I  is  |  OF  KVFRY  IWC.K. 


WlMUCC 

•4»VlCtS 

‘ut*  c*  v:nh 

KITH  Thk 

jrrict  or  *»cst**c** 
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Table  4 

Numbers  of  Subjects  by  Location  and  Squadron 

Location 

Squadron 

Number 

Norfolk 

FAETULANT 

29 

HS  3 

2 

HS  7 

2 

VP  24 

2 

VP  56 

3 

VRC  40 

2 

VRF  31 

1 

VS  26 

2 

VU  6 

3 

Oceana 

VA  42 

2 

VA  43 

10 

VA  75 

1 

VF  101  Det.  A 

5 

VU  2 

1 

65 


I 


a  brief,  general  explanation  of  the  purpose  of  the  research,  the  subjects 
completed  the  two  forms  relating  to  job  tasks.  Then  a  short  rest  period  was 
given  and  a  few  biographical  facts  were  requested.  This  was  followed  by  the 
administration  of  the  Technical  Circuit  Inventory.  Almost  all  the  subjects 
finished  the  three  forms  before  the  end  of  the  three -hour  period,  but  no  time 
limits  were  imposed  on  any  of  the  forms. 

Although,  as  mentioned  in  the  earlier  reports,  the  subjects  were 
able  to  understand  their  task  with  no  apparent  difficulty  and  all  the  forms  were 
essentially  self- administering,  some  comments  and  informal  conversations 
suggested  that  the  subjects  were  somewhat  more  uneasy  with  their  responses 
to  the  Circuit  Inventory  than  they  had  been  with  their  responses  to  the  Task 
Inventories. 
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CHAPTER  III 


THE  MULTIDIMENSIONAL  SCALING  ANALYSIS 

The  method  of  equal  appearing  intervals  was  used  to  scale  the  inter¬ 
circuit  similarity  judgments.  Use  of  this  approach  involved  the  assumption 
that  the  subjects  perceived  the  similarity  scale  categories  as  equal.  Although 
the  category  widths  were  not  explicitly  defined  in  the  directions  for  the 
Technical  Circuit  Inventory  or  in  the  labeling  of  the  scale,  it  seemed  reason¬ 
able  to  make  this  assumption  which  underlies  the  equal  appearing  intervals 
method.  Additionally,  research  recently  completed  by  Applied  Psychological 
Services  has  suggested  that,  for  job  oriented  judgments,  use  of  the  equal 
appearing  or  the  successive  interval  scales  exerts  little  difference  on  the  re¬ 
sulting  dimensionality. 

The  median  judgment  indicated  by  the  65  subjects  was  taken  to  be  the 
scale  value  of  each  circuit  pair.  For  purposes  of  multidimensional  scaling 
analysis,  this  scale  value  is  interpreted  as  the  relative  psychological  distance 
between  that  pair  of  circuits.  As  mentioned  above,  the  goal  of  the  analysis 
is  to  determine  the  number  of  axes  in  the  space  which  accounts  for  the  struc¬ 
ture  defined  by  these  distances  among  all  the  stimuli  (circuits),  and  also  to 
determine  the  projections  of  ;ach  circuit  on  each  of  the  axes. 

For  each  of  the  465  circuit  pairs  of  the  Technical  Circuit  Inventory, 
the  scale  value,  or  inter-circuit  distance,  is  shown  in  Table  5. 
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When  the  entries  of  Table  5  are  compared  with  the  entries  of  the 
analogous  tables  in  the  two  earlier  reports  of  multidimensional  scaling 
analyses  (Schultz  and  Siegel,  1962;  Siegel  and  Schultz,  1963),  it  is  seen  that 
the  inter-circuit  values  are  generally  higher  than  the  inter-task  values.  The 
mean  inter-circuit  distance  shown  in  Table  5  is  7.  95,  while  the  means  of  the 
inter-task  distances  in  the  previous  studies  were  5.50  and  4.98.  Thus,  the 
subjects  indicated  that  the  circuits  were  generally  less  similar  to  one  another 
than  were  the  tasks. 

The  Dimensionality  Analysis 

The  customary  multidimensional  scaling  procedures  were  applied  to 
the  data  of  Table  5.  The  general  solution  to  the  additive  constant  problem 
proposed  by  Messick  and  Abe  Ison  (1956)  was  followed  to  produce  a  value 
which,  when  added  to  the  relative  distances  of  Table  5,  would  result  in  a 
ratio  scale  of  absolute  distances.  The  constant  so  determined  was  2.  03. 

The  smallest  judged  inter-circuit  distance  is  1.79;  therefore,  the  smallest 
corrected  distance  became  3.  82. 

The  matrix  B*  was  then  obtained,  consisting  of  the  scalar  products 
of  the  vectors  to  points  with  an  origin  at  the  centroid  of  the  stimuli.  This 
matrix  is  given  in  Appendix  A  of  this  report. 

The  B*  matrix  was  factored  by  the  method  of  principal  components, 
resulting  in  the  matrix  F  ,  presented  in  Appendix  B.  The  rank  of  matrix  F 
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is  sixteen.  The  matrix  of  residuals,  after  extraction  of  the  sixteen  dimen¬ 
sions  from  the  matrix  B*  is  given  in  Appendix  C. 

The  sixteen  axes  of  matrix  F  were  rotated  to  orthogonal,  simple 
structure  as  determined  by  the  normal  equamax  criterion,  an  analytical 
solution  to  the  problem  of  factor  rotation  developed  by  Saunders  (1962).  The 
transformation  matrix  is  presented  in  Table  6  and  the  final  matrix  of  pro¬ 
jections  of  the  stimuli  (circuits)  on  the  rotated  axes  is  shown  in  Table  7. 


Interpretation  of  Dimensions 

The  circuits  with  the  highest  projections  (loadings)  on  each  dimension 
are  presented  in  Tables  8  through  23.  Examination  of  the  data  in  these  tables 
led  to  the  selection  of  the  names  listed  below  for  the  sixteen  dimensions. 

Since  the  reasons  for  the  names  appear  rather  self-evident,  no  further  ex¬ 
planation  seems  necessary.  In  each  case,  the  dimensional  orientation  of  the 
group  of  task  loadings  on  which  the  name  is  based  is  also  given. 


Table  No. 

Dimension  No. 

Name 

Orientation 

8 

I. 

Frequency  reducing  circuits 

Positive 

9 

II. 

Triggered  circuits 

Positive 

10 

III. 

Regulating  circuits 

Negative 

11 

IV. 

Error  compensating  circuits 

Positive 

12 

V. 

Power  supply  circuits 

Negative 

13 

VI. 

Electron  beam  displacement 
circuits 

Positive 

14 

VII. 

Balancing  circuits 

Positive 

15 

VIII. 

Wave  shaping  circuits 

Negative 
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16 

IX. 

DC  level  establishing  cir¬ 
cuits 

Negative 

17 

X. 

Diode  circuits 

Positive 

18 

XI 

Voltage  reducing  circuits 

Positive 

19 

XII. 

Matching  circuits 

Positive 

20 

XIII. 

Frequency  selection  circuits 

Positive 

21 

XIV. 

Inverter  circuits 

Negative 

22 

XV. 

High  frequency  wave  com¬ 
ponent  favoring  circuits 

Positive 

23 

XVI. 

Information  and  coding  cir¬ 
cuits 

Positive 

Discussion 

A  solution  to  a  multidimensional  scaling  analysis  or  a  factor  analysis 
problem  which  produces  a  rather  large  number  of  dimensions  or  factors 
relative  to  the  number  of  original  variables  may  not  possess  as  much  appeal 
as  one  that  reduces  the  original  complex  to  a  smaller  set  of  underlying  factors. 
In  the  case  of  the  analysis  described  here  the  ratio  of  the  number  of  dimensions 
to  the  number  of  original  variables  was  approximately  one- half;  generally  one 
hopes  to  reduce  the  input  variables  by  more  than  this.  In  the  first  application 
of  multidimensional  scaling  to  job  performance  (Schultz  and  Siegel,  1962),  18 
original  variables  were  reduced  to  4  dimensions.  In  the  second  study  (Siegel 
and  Schultz,  1963),  29  variables  were  accounted  for  in  terms  of  9  dimensions. 
By  contrast,  the  outcome  of  the  present  study  does  not  seem  to  be  as  satis¬ 
factory.  Yet  there  is  nothing  improper  or  unacceptable,  as  such,  with  a  large 
number  of  dimensions.  The  basis  for  the  ultimate  acceptance  or  rejection  of 
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Table  8 

Circuits  with  Highest  Projections  on  Dimension  1 


Circuit  No. 

Loading 

Circuit 

5 

+  6.89 

Attenuator 

12 

+  6.03 

Filter 

4 

+  3.52 

Waveguide 

13 

-  2.  17 

Thyratron  trigger 

22 

-  2.45 

RF  oscillator 

8 

-  2.50 

Magnetron 

-  25  - 


Table  9 


Circuits  with  Highest  Projections  on  Dimension  II 


Circuit  No. 

Loading 

Circuit 

10 

+  6.  35 

Flip-flop 

9 

+  5.  80 

Single -shot  multivibrator 

24 

+  3.  14 

Blocking  oscillator 

19 

+  2.  11 

Sweep  oscillator 

23 

-  2.24 

Regulator 

16 

-  2.40 

Automatic  frequency  control 

-  26  - 


Table  10 

Circuits  with  Highest  Projections  on  Dimension  III 


Circuit  No. 

Loading 

Circuit 

3 

+  2.  57 

Klystron 

11 

6 


-  6.05 

-  7.  66 


Transformer 

Servomechanism 
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Table  11 

Circuits  with  Highest  Projections  on  Dimension  IV 


Circuit  No. 

Loading 

Circuit 

23 

+  3.  26 

Regulator 

16 

+  2.  01 

Automatic  frequency  control 

22 

-  2.70 

RF  oscillator 

3 

-  2.72 

Klystron 

8 

-  4.71 

Magnetron 

4 

-  6.61 

Waveguide 

-  28  - 


Table  12 

Circuits  with  Highest  Projections  on  Dimension  V 


Circuit  No. 

Loading 

Circuit 

13 

+  2.89 

Thyratron  trigger 

18 

-  2.52 

Bridge 

28 

-  2.63 

DC  restorer 

17 

-  4.43 

Rectifier 

15 

-  6.09 

Voltage  doubler 

-  29  - 


Table  13 


Circuits  with  Highest  Projection  on  Dimension  VI 


Circuit  No.  Loading  Circuit 

29  +  9. 20  Cathode  ray  tube 


Table  14 

Circuits  with  Highest  Projections  on  Dimension  Vll 


Circuit  No. 

Loading 

Circuit 

18 

+  5.57 

Bridge 

23 

+  2.  61 

Regulator 

17 

+  2.26 

Rectifier 

15 

+  2.  11 

Voltage  doubler 

6 

+  2.05 

Servomechanism 

7 

-  2.54 

Ringing 

22 

-  2.  61 

RF  oscillator 

24 

-  4.03 

Blocking  oscillator 

-  30  - 


Table  15 


Circuits  with  Highest  Projections  on  Dimension  VIII 


Circuit  No. 

Loading 

Circuit 

30 

-  4.92 

Differentiator 

25 

-  6.  62 

Integrator 

Table  16 

Circuits  with  Highest  Projections  on  Dimension  IX 


Circuit  No. 

Loading 

Circuit 

28 

-  4.  51 

DC  restorer 

26 

-  6.24 

Clipping 

-  31  - 


Circuits 

Table  17 

with  Highest  Projections 

on  Dimension  X 

Circuit  No. 

Loading 

Circuit 

14 

+  4.  95 

Detector 

17 

+  3.  77 

Rectifier 

18 

+  2.47 

Bridge 

3 

19 


-  3.  67  Klystron 

-  3.  81  Sweep  oscillator 
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Table  18 


Circuits  with  Highest  Projections  on  Dimension  XI 


Circuit  No. 

Loading 

Circuit 

13 

+  3.  63 

Thyratron  trigger 

23 

+  2.  33 

Regulator 

28 

+  2.  25 

DC  restorer 

22 

-  2.  87 

RF  oscillator 

1 

-  6.42 

Mixer 

Table  19 

Circuits  with  Highest  Projections 

on  Dimension  XII 

Circuit  No. 

Loading 

Circuit 

2 

+  7.  15 

Cathode  follower 

28 

+  2.  14 

DC  restorer 

3 

-  2.  26 

Klystron 
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Circuits 

Table  20 

with  Highest  Projections 

on  Dimension  XIII 

Circuit  No. 

Loading 

Circuit 

20 

+  4.95 

Frequency  discriminator 

16 

+  3.  79 

Automatic  frequency  control 

19 

+  2.40 

Sweep  oscillator 

14 

+  2.22 

Detector 

8 

-  2.24 

Magnetron 

7 

-  4.23 

Ringing 
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Table  21 


Circuits  with  Highest  Projections  on  Dimension  XIV 


Circuit  No. 

Loading 

Circuit 

31 

-  7.94 

Inverter 

Table  22 

Circuits  with  Highest  Projections  on  Dimension  XV 


Circuit  No.  Loading 

27  +6.21 

30  +  3. 15 


Circuit 

Peaking 

Differentiator 


23 


-  2.  69 


Regulator 
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Table  23 

Circuits  with  Highest  Projections  on  Dimension  XVI 


Circuit  No. 

Loading 

Circuit 

21 

+  6.55 

Modulator 

8 

+  2.  39 

Magnetron 

13 

+  2.30 

Thyratron  trigger 

lb 

-  2.66 

Automatic  frequency  control 
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the  solution  should  probably  be  framed  in  terms  of  the  meaningfulness  and 
utility  of  the  dimensions  uncovered. 

Generally,  the  circuit  groupings  produced  in  this  study  appeared  to 
be  logical  and  meaningful.  Of  the  16  dimensions  in  the  final  matrix,  the 
interpretation  of  12  seemed  fairly  clear.  Some  novel  groupings  were  pro¬ 
duced  which  might  not  have  been  suggested  in  the  absence  of  the  multidimen¬ 
sional  scaling  data. 

On  the  negative  side,  somewhat  less  confidence  is  felt  in  the  inter¬ 
pretation  of  Dimensions  VII,  IX,  XI,  and  XIV  (balancing,  DC  level  establish¬ 
ing,  voltage  reducing,  and  inverter)  than  in  the  interpretation  of  the  other 
dimensions.  Also,  the  precise  nature  of  the  difference  between  the  two 
"regulating"  dimensions.  III  and  IV,  is  not  clear.  In  general,  the  interpre¬ 
tation  of  the  circuit  dimensions  seemed  somewhat  more  difficult  than  the 
interpretation  of  the  task  dimensions  in  the  previous  two  multidimensional 
scaling  studies  (Schultz  and  Siegel,  1962;  Siegel  and  Schultz,  1963).  It  is 
not  known  whether  this  was  caused  by  the  inherent  nature  of  the  subject 
matter  involved  or  by  the  inadequacies  of  the  method. 

It  was  mentioned  in  the  earlier  reports  that  since  the  last  stage  in 
a  multidimensional  scaling  analysis  involves  factor  analysis  methods,  the 
outcomes  are  limited  by  the  input  data.  In  the  present  study,  the  input  data 
were  derived  from  a  list  of  circuits  which  had  been  constructed  according  to 


guidelines  stressing  the  inclusion  of  different  types  of  circuits.  A  question 
may  be  raised,  then,  as  to  the  degree  of  "purity"  or  "independence"  that 
was  attained  in  that  list  and  the  resultant  effect  on  the  dimensionality  struc¬ 
ture. 

If  the  difficulties  lie  with  the  original  circuit  list  as  developed,  it 
might  be  fruitful  to  apply  other  classificatory  schemes  to  the  circuit  con¬ 
stellation.  A  stimulus  list  of  circuits  described  in  terms  more  functionally 
related  to  troubleshooting  skills  might  produce  a  more  efficient  underlying 
structure.  Or,  on  the  other  hand,  it  might  be  helpful  to  start  with  terms  at 
the  whole-equipment  level.  Some  thought  should  perhaps  be  given  to  the 
possible  utility  of  such  alternative  approaches  to  the  stimulus  list  develop¬ 
ment. 

If  no  more  efficient  descriptive  system  is  found,  the  16  dimensions 
produced  in  this  study  as  underlying  the  circuits  worked  on  by  aviation 
electronics  technicians  might  be  accepted  for  use  in  further  investigations. 
Such  work  might  take  the  form  of  developing  unidimensional  scales  for  some 
or  all  of  the  dimensions.  Or  they  might  be  utilized  in  a  cross-dimensional 
description  of  the  AT's  job  by  relating  them  to  the  task  dimensions  found  in 
the  previous  studies.  The  potential  utility  and  application  of  the  outcomes 
of  multidimensional  scaling  analyses  have  been  fully  discussed  in  the  earlier 
reports  and  in  the  introductory  chapter  of  this  report. 
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CHAPTER  IV 


SUMMARY  AND  CONCLUSIONS 


Summary 

Two  recent  studies  (Schultz  and  Siegel,  1962;  Siegel  and  Schultz,  1963), 
carried  out  at  Applied  Psychological  Services,  investigated  the  applicability  of 
multidimensional  scaling  techniques  to  the  tasks  performed  by  Naval  aviation 
electronics  technicians  at  two  job  levels.  Specific  techniques  were  developed 
and  the  fruitfulness  of  the  multidimensional  methods  in  this  situation  were 
demonstrated.  The  study  described  in  this  report  approached  the  aviation 
electronics  technician's  job  from  another  standpoint- -that  of  the  avionic  cir¬ 
cuits  on  which  he  works.  The  study  was  designed  to  extend  the  general  inves¬ 
tigation  of  the  applicability  of  multidimensional  scaling  techniques  in  the  job 
performance  area  by  using  the  techniques  with  a  somewhat  different  kind  of 
source  data. 

The  specific  objectives  of  the  present  study  were  to:  (1)  assess  the 
value  of  multidimensional  scaling  techniques  for  classifying  avionic  circuits, 

(2)  adapt  and  investigate  previously  devised  methods  for  applying  these 
techniques  to  avionic  circuits,  and  (3)  determine  the  number  and  the  nature  of 
the  dimensions  underlying  the  circuits  repaired  by  Naval  aviation  electronics 
technicians. 
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Similar  procedures  and  analogous  forms  to  those  of  the  earlier  work 
were  used.  The  same  judges  were  involved.  A  list  of  circuits  which  a  Naval 
aviation  electronics  technician  might  normally  be  expected  to  work  on  was 
developed  by  an  engineer  knowledgeable  in  aviation  electronics  maintenance. 
When  this  list  was  presented  to  a  group  of  AT  instructors  possessing  long  and 
varied  experience  in  the  rating,  there  was  considerable  agreement  among  them 
that  31  of  the  34  circuits  on  the  original  list  constituted  all  the  avionic  circuits 
that  are  characteristically  worked  on  by  aviation  electronics  technicians. 

The  31  circuit  names  were  printed  in  a  booklet,  arranged  in  such  a 
way  that  each  circuit  could  be  compared  with  every  other  one.  A  group  of 
chief  and  first  class  petty  officers  in  the  AT  rating  then  made  a  similarity 
judgment  for  each  circuit  pair.  The  judgments  were  analyzed  by  the  method 
of  equal  appearing  intervals  to  produce  a  matrix  of  scale  values  which,  in 
multidimensional  scaling,  are  taken  as  the  inter-stimulus  (in  this  case, 
inter-circuit)  distances. 

The  usual  multidimensional  scaling  analysis  methods  were  then  utilized. 
First,  the  technique  described  by  Messick  and  Abelson  was  applied  to  obtain  a 
constant  which,  when  added  to  the  inter-circuit  distances,  would  place  them  on 
a  ratio,  rather  than  merely  an  interval,  scale.  A  matrix  of  scalar  products 
was  computed  from  the  "absolute"  distance  values  and  was  factored  by  the 
method  of  principal  components.  The  extracted  factor,  or  dimensional. 
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matrix  was  rotated  to  orthogonal  simple  structure  as  defined  by  the  equamax 
criterion. 

The  spatial  system  arising  out  of  the  analysis  involved  sixteen  dimen¬ 
sions.  Examination  of  the  groups  of  circuits  with  the  highest  loadings  pro¬ 
duced  the  following  names  for  these  underlying  dimensions: 

I.  Frequency  reducing  circuits 

II.  Triggered  circuits 

III.  Regulating  circuits 

IV.  Error  compensating  circuits 

V.  Power  supply  circuits 

VI.  Electron  beam  displacement  circuits 

VII.  Balancing  circuits 

VIII.  Wave  shaping  circuits 

IX.  DC  level  establishing  circuits 

X.  Diode  circuits 

XI.  Voltage  reducing  circuits 

XII.  Matching  circuits 

XIII.  Frequency  selection  circuits 

XIV.  Inverter  circuits 

XV.  High  frequency  wave  component  favoring  circuits 

XVI.  Information  and  coding  circuits. 

Although  sixteen  dimensions  seemed  like  a  large  number  relative  to  the 
number  of  original  variables,  the  groupings  appeared  to  be  meaningful  in  most 
cases  and,  therefore,  seemed  to  constitute  a  tentative  descriptive  system  of 
the  factors  underlying  the  circuits  repaired  by  Naval  aviation  electronics 
technicians.  It  was  suggested  that  attempts  be  made  to  develop  alternative 
approaches  in  the  circuit-equipment  area. 
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Conclusions 


The  following  conclusions  seem  warranted  by  the  results  of  the  study 
described  in  this  report: 

1.  It  is  feasible  to  apply  multidimensional  scaling 
techniques  to  the  problem  of  classifying  electronic 
circuits  repaired  in  the  performance  of  Naval  jobs. 

2.  The  methods  and  materials  previously  developed  for 
utilizing  multidimensional  scaling  techniques  in  the 
job  performance  area  can,  with  slight  modification, 
be  applied  to  electronic  circuits  as  the  stimulus 
materials. 

3.  The  avionic  circuits  worked  on  by  Naval  aviation 
electronics  technicians,  as  represented  in  the  cir¬ 
cuit  list  developed  in  this  study,  are  perceived  by 
supervisory  personnel  in  the  rating  as  involving 
sixteen  underlying  dimensions. 
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APPENDIX  A 


Appendix  A  presents  the  matrix  B* 
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APPENDIX  B 


Appendix  B  presents  the  matrix  F 
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APPENDIX  C 


Appendix  C  presents  the  matrix  of  residuals  after 
extraction  of  sixteen  dimensions  from  matrix  B* 


-50- 


I 

f 

«<Ory^  —  «£wnT3r->Nf'i/'OfV»->0'0<*  ^4£lV0V«^00«^990 
ot^^^/'^0'CDN.ir'^^^ir^i?'-^0DX'r^ffG('JirO(v«,i 


rgHWOO^^O^^MON^ONOoCNO^OOCOANO^O 
I  I  I  II  I  II  I  I  I  I  I  I  II  I 


OOOf«NM5N/<''"-Nr)i«MVO^Oi  OO»<0'<*<NNON*< 
I  I  I  I  I  I  I  II  I  III 


L 


h»Wirfg^H-N-CHNMIAMHffNNIM*«h>«l»*OlMrK 

m-*-O-00#''<O0ftiNO0-<-O-OOirNOONNN0-0 
I  I  I  I  I  I  I  II  I  I  I  I  I  I  I  I 


i/\(*i*<*ipriis\r*»ri<#*®9trrM*<6i/N4>  +  *>orui/*ir>Oh»<,*o>£<DfM 

CC««--NOO‘-NN^yO-OJ  -  0^-^000^00000 
III  I  I  I  I  1  I  I  I  I  I  I  1 


««**O»K<6ir««h>r»+1*+IA**'0«XfAa»O«4NfM  +  M'#K 


—  -  ^N'^rDO^'J^OO  -*  -^  O  O  —  O 
I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 


*-»—(N!C^O^-r\Of\jOfVJf\O^C<V^Ot.  —  C  C  c;  -« 
(  I  I  I  I  I  I  I  I  I  I  I  III 


^<r  ♦  r .  --  o  o*  ^  i/*  *-  j*  ^  jo  .%  •  j^acj'octcir  *  ~-  **  •-  r»  ^  n  pg 
^  ^  -  r»  —  f*  r 

I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 


t  u  m  o  (i  ••  «  o  •*■>;<>«  c  t 

II  I  I  I  I 


<  o  c  ■Mfic.-vj^wcHoir-j 
till  I  I  I  I 


O^Nff--trtTOOMON\<NOiACC>SOff  'JO^XI-WNH 

®*«®r*c,Ko®-<®f^oo®»MC'r^iv^ir^^o  x  o  *-  j  «•  c>  <v  m 


-oonnoo-oho-'--onoo4o--«ooc  o*«or  v 
III  I  III  I  I  I  I  I  I  I  I 


^^ivoorio^OfM®ocvi**fx©^^i^  *oi\.»'»^^o  •'.f'j©**© 

II  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 


I 


51 


I 


r» 

% 


—  »ir  ^  oj  i/\  ^  o 

t®  ®  o  ^  c«  f\J  o 


^  irir  n 

-*  INI  <\f  <0  O  * 

-*  flD  «#  ^  C*>  O  O' 

CO  *  I*  ^  rg  *  o 


o 

»r 

rg 


CJ 

>C 

IT 

X 


if\  ^ 
®  *• 
ec  *- 


»  <6 
NC  4 
(Ni  <£ 
<P  fV 


OOl/'XOOOO^^  -•N'OrvjfNJ'V^Mi-'^O'VJ^OOO  ©  o  <  .>  © 
I  t  I  II  I  III*  III  i  I 


o  '*  «*  **  a;  pm  *»•  **  * 

Nffir^^wn»u',<'-i'iff»N-#N»->ftjse(«oooKN(rg 

N^HONOHN00^^Ntf>N'*'i<'HO-'-‘ON^-Mn-4OC3O 
I  I  I  I  t  I  I  I  I  I  III  III 


c 

0 


.*•  t  no  o  r  •*  -o  «■*  >c  «r 

<^NN«Kaff^»W®HSMrOINirOt/'» 

"*i(Njrv<Or<\^^rr»— *«  cu  f*  *»  «  o 

-<0^<\icsj«'''00'*0'C--0  —  i_>rgr\i«--*0OOf\if\i<\if\irM0O*,f\l 
I  II  III  I  I  I  II 


-«  O  iT  ^  O  f*  O  T 


£, 


^O'.Jf'ga^N.O— 0  0000-^0 
I  I  I  I  I  I  III  I  I  I  I  I  I  I 


-  f  •-  #  -  K  —  ^ar^KN®f>g 


ill  III  I  I  I  I  I  I  I  I  I  I 


<r 

ONt^t^-C^  -  ■/* 


\OPC  t.  •+  ■  i  ISC 
III  I 


X-OWJ'N-BCJ^ 

—  &  -*  r*  >c  <+\ 


II  III 


uNooff  ♦**»  r»  o  ^ 


^0C-#0#\j00^r; 

I  III  I 


1. 

[ 

I 


•#  (N<  ^  ^  (*W  ^  XNiT(^».NiM\i0C.O»*KMfNN^*0»  ®  fSJ  f« 

—  **  IT  ♦  o  ®  ♦  !  <*  in 

^  —  o  *  *.  -*  <  >  O  <-'  —  —  0  00^0 

I  I  I  I  I  I  I  II  II  I  I  I  I  I 


'0fMOrges.4"**Ot/'P»h-O*iO‘e»«*i'*iSH'0^-«f'»'l*««rtr«flD<N 


nv  —  —  o  —  <\n^rv.orv<S^-C  o  f*1  .'-f.MVON-f 
I  I  I  I  I  I  I  I  I  I  I 


oco—«ac-o 
I  I  I 


n 

3 


OMOBONMM^OtAO^N^N^^rN^iyONMniAnoOM 
I  I  I  I  I  I  I  II  II  I  II  I 


h(«0*-rt(«0NN4 

*fNo^co-«i***p* 

*«o»«o©^pv^©^© 
I  I  I  t  I  I 


HNr^r'tfSCITO-M^^^ONC^O-N^^f^Ne^O- 

M»4Mrt^p<p«^Mp.rulSNNNNN(\Nnf*«m 


52 


I 

[ 

r 


i 

I 


i 

L 


*  4N4^ClA«lA«l/\9><#*4K9mN«^n<0^^fAO^«^OhM 

N  -OON-mN'flNONrtilflf'^mONN^^irtyM'KVtAO^^O- 

OOOOOOQOOOOOOOOOOOOOOOOOOOOrOOO 
III  II  I  I  I  I  I  I  III 

f*  —  —  NOOO  —  <N<^  —  **  —  OOfNJOO  —  —  —  0000000©'*0 

it  i  I  i  i  i  iii  i  T  i  I 


»»(AOK4K««OAlA«C»O-0-OOn4««»e»O»>« 

M9a-»NNO-094<n40iro)f)«in40o^NKM«iAo 

+  r»%eo  —  bn  —  rw— ^  +  cg  —  —  otAire— *»<+  —  «**\r>-  — 

oonnoo-n-o-*ono«onnono-o^--oono 
I  I  I  I  I  I  I  I  I  I  I  I  III  I 

N  —  Nh«90AmNONMr#cmo«N«irM 

009KN4mK#0N»»#IM-4lA0M»»MM<«NNN-i  »■ 
-0#-0  000-00-0\#(*OM-OCH^-0("-<f«0*C 

III  II  I  I  I  I  I  I  I  I  I  I  II 


MDN.(|n»^MM^co^MOnK«t^lAON»««>*Min*AO 

no-b«oo—  *  +  —  b**«c***>coo  +  wF»«o<*~  —  -  ^ 

•  •<*J*B**##B*m*NC-N^f***N  —  —  t/'.^NNBT***** 

—  oof*<*ooocoo  —  o  —  oo’-'n  —  ooi*oc  —  o  o  o  e  —  o 
I  i  i  i  t  I  i  I  i  •  i  i  t  i  •  i 

^)9^iA#ID1-»Mir^«««Nff,'*tNC^9090®0*NO-<N 

0N0»«<|S«^»0#IMre«C^N-\H®4N-  —  N  «  *  B  » 

^O^TB^OBOBB+Nf*  —  «  —  N  **  •  —  NOirf'N-  m  o*  b  ©  b 

N  —  ©  —  N  —  O  —  —  O  —  ©  B  —  O  N  —  N  N  *  —  O  fV  ©  —  —  U  ©  C  ©  '- 

I  I  I  I  I  I  I  I  1  I  I  I  I  I  I  I 

SSScoSJSPIooSSJhIo-oJonoJSISoSSo 

V>«B*«BIS— F»*OOBP»B*  0fN<900-9#9-^MT 

•  •••••••••••••••••••••••ft***#* 

KrtdlAOO-fO-ON^tM-nOON^^OM-OOOCNO 

III!  It  lilt  III  I  II 


o  —  n+ooo^bbbopb* 


©  —  O  ©  B  —  **  O  ©  C  —  BN  —  —  O  ©  O  —  ON**  OONO«  O  O 
II  I  I  I  I  I  I  I  I  I  I  I  I 


-  NBBBBN«T9-^  —  NBBBBNXf*©  — 
—  —  —  —  —  —  —  —  —  —  NNNfVrv  N  N  N  fV  N  ■*  ** 


53 


